IMAGE DISTORTION CORRECTING APPARATUS AND METHOD THEREOF 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

The present invention relates to an image distortion correcting apparatus 
for an image display device, and in particular to an image distortion correcting 
apparatus capable of correcting keystone distortion and pincushion distortion 
occurred in an image display device efficiently. 

10 

2. Description of the Conventional Art 

Recently, among image display devices, a projection TV displaying 
enlarged TV images on a large screen has optical distortion inevitably. The optical 
distortion can be divided into pincushion distortion and keystone distortion. Herein, 
15 the pincushion distortion occurs by a CRT (cathode ray tube; CRT) and a lens, and 
the keystone distortion occurs by reflection through a reflector. 

Figure 1 illustrates optical distortion occurred in a projection TV. 

As depicted in Figure 1, the projection TV includes CRTs (respectively 
having a lens for enlarging a video signal) 11, 12, 13 for enlarging an input video 
20 signal and outputting it; a reflector 14 for reflecting an image respectively outputted 
from the CRTs 11, 12, 13; and a screen 15 for displaying a RGB image reflected 
onto the reflector 14. 

Operation of the projection TV will be described. 

First, the three R, G, B CRTs 11, 12, 13 are not arranged at the same 
25 position but arranged side by side. Each R, G, B CRT 11, 12, 13 enlarges a 
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received image and outputs it to the reflector 14. The reflector 14 displays the 
enlarged image on the screen 15. Accordingly, the screen 15 displays a certain 
enlarged color image. 

However, because the image displayed on the screen 15 is affected by the 

5 plural CRTs 11, 12, 13 and the reflector 14, optical distortion occurs inevitably in 
displaying of the image. In more detail, in case of an image displayed on the 
screen 15 in the projection TV, according to relation between arranged position of 
the CRTs 11, 12, 13 and reflection position of the reflector 14, electron beam locus 
of the image respectively outputted from the CRTs 11, 12, 13 may not be coincided 

10 with each other. Accordingly, crooked or angled electron beam locus may occur on 
the center, edge, top/bottom and left/right of the screen 15. As described above, 
image distortion occurs inevitably in the projection TV, and accordingly quality of 
an image displayed on the screen is lowered. Herein, the electron beam locus 
means a straight line connecting each CRT 11, 12, 13 to an image-displayed point 

15 on the screen 15. 

Figure 2 illustrates simulation results of optical distortion occurred in a 
projection TV. 

As depicted in Figure 2, in order to show optical distortion occurred in the 
projection TV, simulations were performed by using a reference grid image 21. 
20 First, a first grid image 22 shows a keystone distortion occurred in the reference 
grid image, and a second grid image 23 shows a pincushion distortion occurred in 
the reference grid image 21. In addition, a third grid image 24 shows both a 
keystone distortion and a pincushion distortion occurred in the reference grid 
image. 

25 As described-above, in the reference grid image 21 of the three CRTs 11, 



12, 13, because each CRT has a different reflection point on the reflector 14 and 
has a different reflection path to the screen 15, the keystone-distorted image 22 
having a ladder shape occurs. And, the pincushion-distorted image 23 symmetric 
on the top and bottom-right and left on the basis of the center of the screen 15 
5 occurs. Herein, the farther from the center of the screen 15, the more severely 
distortion occurs. 

Accordingly, in the reference grid image 21, because the three CRTs 11, 

12, 13 are not installed at the same position but arranged in parallel, a degree of 

the keystone and pincushion distortion is different at the top, bottom, right and left 
10 of an image, due to that the image can not be displayed at the same point of the 

screen 15, and accordingly a misconvergence phenomenon occurs. Because of 

that problem, picture quality of the projection TV is lowered. 

In order to solve the above-mentioned problem, an image distortion 

correcting apparatus using a convergence yoke is widely used. 
15 Figure 3 is a schematic block diagram illustrating a concept of an image 

distortion correcting apparatus using a convergence yoke in accordance with the 

conventional art. 

As depicted in Figure 3, in the image distortion correcting apparatus using 
the convergence yoke, by installing a convergence yoke 32 at a CRT 31 receiving 
20 a video signal and applying an appropriate correcting current to the convergence 
yoke 32 in the horizontal and vertical directions, a path of a video signal outputted 
from the CRT 31 is adjusted. Accordingly, the optical distortion of a projection 33 
can be corrected, and the convergence-adjusted video signal can be displayed on 
a screen. 

25 However, the image distortion correcting apparatus using the convergence 
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yoke shows nonlinear characteristics such as severe optical distortion, it is very 
intricate to correct the optical distortion and maintain a high resolution of the image 
continually after the convergence is adjusted. In addition, in the correcting 
apparatus using the convergence yoke, in order to get a current received to the 
5 convergence yoke 32, a control signal having non-linearity has to be generated, 
the received current has to be amplified, and accordingly complicated operation 
and devices are required to process the optical distortion. 

In addition, because the correcting apparatus using the convergence yoke 
uses variation of a magnetic field by adjusting a current received to the 
10 convergence yoke 32, it is influenced by the earth magnetic field, and accordingly 
re-correction is required after performing the distortion correction. In that case, a 
product has to be re-called, it is not efficient for not only user but also a 
manufacturer. 

In the meantime, recently not only a CRT-based projection TV but also a 
is LCD (liquid crystal display; LCD)-based projection TV has been provided. In 
comparison with the CRT, because the LCD is thinner and lighter, it is easy to 
move, and accordingly a wall-type TV impossible to implement with the CRT can 
be implemented with the LCD. In addition, the LCD has smaller power 
consumption, it is efficient in the economical aspect. However, the image distortion 
20 correcting apparatus using the convergence yoke can not be applied to the LCD- 
based projection TV, a new image distortion correcting method has been required. 

SUMMARY OF THE INVENTION 

25 In order to solve the above-mentioned problem, it is an object of the 
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present invention to provide an image distortion correcting apparatus having a 
lighter weight which is capable of not using an additional convergence yoke by 
correcting image distortion by a digital image processing technique. 

It is another object of the present invention to provide an image distortion 
5 correcting apparatus capable of having a longer life-span by reducing influence of 
electromagnetic field due to convergence yoke by correcting image distortion by a 
digital image processing technique. 

It is yet another object of the present invention to provide an image 
distortion correcting apparatus capable of improving productivity of a product 

10 manufacturing step including an image distortion correcting process by correcting 
image distortion by a digital image processing technique. 

In order to achieve the above-mentioned objects, an image distortion 
correcting apparatus in accordance with the present invention includes a reference 
image generating means for generating a reference image and setting a 

15 coordinate of the reference image; a displacement measuring means for 
displaying the reference image on a screen and measuring a coordinate of the 
displayed image; a distortion information extracting means for extracting distortion 
information on the basis of a coordinate value of the set reference image and a 
coordinate value of the measured image and generating inverse-distortion 

20 information; and a distortion correcting means for generating an inverse-distorted 
(pre-warping) image of the reference image on the basis of the generated inverse- 
distortion information. 

In order to achieve the above-mentioned objects, an image distortion 
correcting apparatus in accordance with the present invention includes a digital 

25 video signal processing means for converting an input video signal into a digital 
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video signal; an inverse-distortion processing means for performing inverse- 
distortion processing of the digital video image on the basis of the stored inverse- 
distortion information; a distortion correction memory means for storing inverse 
distortion information for inverse distortion-processing; and an image projecting 

5 means for displaying the inverse distortion-processed image on the basis of the 
distortion correction information of the distortion correction memory means. 

In order to achieve the above-mentioned objects, an image distortion 
correcting method in accordance with the present invention includes measuring a 
keystone distortion-parameter by displaying an input image on a screen; 

10 performing inverse keystone distortion-correction of the input image on the basis 
of the measured keystone distortion-parameter; measuring a pincushion distortion- 
parameter by displaying the inverse keystone distortion-corrected image on the 
screen; and performing inverse pincushion distortion-correction of the image 
displayed on the screen repeatedly on the basis of the measured pincushion 

15 distortion-parameter. 

In order to achieve the above-mentioned objects, an image distortion 
correcting method in accordance with the present invention includes initializing a 
virtual screen showing keystone distortion and pincushion distortion; generating an 
inverse-distorted image on the basis of the initialized virtual screen; generating a 

20 distortion-corrected image on the basis of the generated inverse-distorted image 
and displaying the generated image on a screen; comparing the distortion- 
corrected image with the image displayed on the screen; updating the virtual 
screen when the image displayed on the screen is not coincided with the 
distortion-corrected image; and finishing the virtual screen updating when the 

25 image displayed on the screen is coincided with the distortion-corrected image. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are included to provide a further 
5 understanding of the invention and are incorporated in and constitute a part of this 
specification, illustrate embodiments of the invention and together with the 
description serve to explain the principles of the invention. 

In the drawings: 

Figure 1 shows optical distortion occurred in a projection TV; 
10 Figure 2 shows simulation of optical distortion occurred in a projection TV; 

Figure 3 is a schematic block diagram illustrating a concept of an image 
distortion correcting apparatus using a convergence yoke in accordance with the 
conventional art; 

Figure 4 is a block diagram illustrating a concept of an image distortion 
15 correcting apparatus in accordance with the present invention; 

Figure 5 is a block diagram illustrating a construction of the image 
distortion correcting apparatus in accordance with the present invention; 

Figure 6 is a block diagram illustrating an image distortion correcting 
method in accordance with the present invention; 
20 Figure 7 illustrates a pincushion distortion phenomenon in accordance with 

the present invention; 

Figure 8 shows a virtual plane modeling the pincushion distortion in 
accordance with the present invention; 

Figure 9 shows a virtual plane modeling the keystone distortion in 
25 accordance with the present invention; 



Figure 10 is a flow chart illustrating a virtual screen processing method in 
accordance with the present invention; 

Figure 11 is a block diagram illustrating a relation between input and 
output of a silicon convergence device in accordance with the present invention; 

Figure 12 is a block diagram illustrating a generation order of image 
coordinates in accordance with the present invention; 

Figure 13 is a block diagram illustrating a digital image storing method in 
accordance with the present invention; 

Figure 14A illustrates timing at which digital data is written in a memory of 
the image distortion correcting apparatus in accordance with the present invention, 
and Figure 14B illustrates timing at which digital data is read from a memory of the 
image distortion correcting apparatus in accordance with the present invention; 

Figure 15 is for describing a concept of one-dimensional signal 
interpolation in accordance with the present invention; 

Figure 16A illustrates a nearest interpolation function in accordance with 
the present invention, and Figure 16B illustrates Fourier conversion of the nearest 
interpolation function in accordance with the present invention; 

Figure 17 is for describing a concept of a two-dimensional nearest 
interpolation in accordance with the present invention; 

Figure 18 is for describing a concept of linear interpolation in accordance 
with the present invention; 

Figure 19A illustrates a linear interpolation function in accordance with the 
present invention, and Figure 19B illustrates Fourier conversion of the nearest 
interpolation function in accordance with the present invention; 

Figure 20 is for describing a concept of linear interpolation in accordance 
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with the present invention; 

Figure 21 illustrates interface between a PC and a silicon convergence 
device in accordance with the present invention; and 

Figure 22A illustrates an example of a test image before performing 
5 conversion correction in accordance with the present invention, and Figure 22B 
illustrates an example of a test image after performing distortion conversion. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

10 Hereinafter, the preferred embodiment of an image distortion correcting 

apparatus capable of correcting keystone conversion and pincushion conversion 
efficiently by correcting image distortion on the basis of a three-dimensional virtual 
screen in accordance with the present invention will be described in detail with 
reference to accompanying drawings. 

15 The image distortion correcting apparatus in accordance with the present 

invention performs modeling of a distortion process mathematically while a 
reference image is displayed on a screen and performs an inverse-distortion 
process on the basis of the modeling before displaying the reference image stored 
in a memory on a screen, and accordingly the image distortion-corrected image, 

20 namely, an image same with the image stored in the memory is displayed. 

Figure 4 is a block diagram illustrating a concept of an image distortion 
correcting apparatus in accordance with the present invention. 

As depicted in Figure 4, the image distortion correcting apparatus 
performs inverse distortion image-processing of an image received from an image 

25 processing unit 41 and outputs the inverse distortion-processed signal to a CRT 42, 
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and a projection 43 receives the inverse distortion-processed signal from the CRT 
42 and displays it on a screen. In more detail, because the inverse distortion- 
processed signal is influenced by the keystone distortion and pincushion distortion 
while being displayed on the screen, the corrected image, namely, an image same 
5 with the reference image is displayed on the screen. 

The image distortion correcting method for modeling the image distortion 
process mathematically and correcting the image distortion on the basis of the 
modeling will be described. 

First, when the reference image is l{x,y), the image processing unit 41 

10 performs inverse distortion-processing of the reference image l(x,y) and outputs 
it to the CRT 42. Herein, when a function for modeling the image distortion process 
mathematically is T and a function for modeling the inverse-distortion process 
mathematically is T~ l , the inverse distortion-processed image is T~ l [l(x,y)]. 
Accordingly, the CRT 42 outputs the inverse distortion-processed image 

15 r _1 [/(;c,.y)] to the projection 44, and the projection 43 displays the inverse 
distortion-processed image is r _1 [/(*,;/)] . Herein, because image distortion 
occurs while displaying the image on the screen, an undistorted reference image 
l(x,y) described as r{r -1 [/(*,>;)] } = l(x,y) is displayed. 

Hereinafter, the inverse distortion-correcting function T~ l is obtained and 

20 is implemented as hardware-like. In particular, a method for correcting the image 
distortion by modeling the inverse distortion-correcting function T~ l 
mathematically on the basis of a three-dimensional virtual screen technique and 
calculating a correcting parameter on the basis of that will be described. 

Figure 5 is a block diagram illustrating a construction of the image 

25 distortion correcting apparatus in accordance with the present invention. 



As depicted in Figure 5, the image distortion correcting apparatus includes 
a projection TV unit 510 and an inverse-distortion information generator 520. 
Construction and operation of the projection TV 510 and the inverse-distortion 
information generator 520 will be described in detail. 

5 First, the projection TV unit 510 includes analog video signal units 51a, 

52a, 53a and digital video signal units 51b, 52b, 53b for receiving video signals; 
analog/digital converters 54a, 54b, 54c for-cpnverting analog video signals into 
digital video signals; multiplexers 55a, 55b, 55c for selecting one of output signals 
or one of digital video signals outputted from the analog/digital converts 54a, 54b, 

10 54c; a distortion corrector 56 for performing inverse-distortion processing of the 
signals outputted from the multiplexers 55a, 55b, 55c on the basis of inverse- 
distortion correcting information; a memory 57 for storing the inverse-distortion 
correcting information (parameter); a image projection processor 58 for receiving 
an inverse-distortion-processed signal from the distortion corrector 56; and a 

15 screen 50 for displaying the inverse-distortion-processed signal outputted from the 
image projection processor 58. 

The projection TV unit 510 receives the analog video signals and the 
digital video signals. Herein, the analog video signals are converted into digital 
video signals by the analog/digital converts 54a, 54b, 54c. Each multiplexers 55a, 

20 55b, 55c selects one of signals outputted from the analog/digital converts 54a, 54b, 
54c or one of video signals outputted from the digital video signal units 51b, 52b, 
53b and outputs it to the distortion corrector 56. The distortion corrector 56 
performs a keystone inverse-distortion and pincushion inverse-distortion 
processing process of the outputted video signal on the basis of the inverse- 

25 distortion correcting parameter stored in the memory 57 and outputs it to the 



image projection processor 58. The image projection processor 58 displays the 
keystone inverse-distortion and pincushion inverse distortion-processed signal on 
the screen 59. Herein, when the video signal is displayed on the screen 59, 
keystone distortion and pincushion distortion occur inevitably. Accordingly, when 

5 the inverse distortion-processed video signal is displayed on the screen 59, the 
original image not affected by the keystone distortion and the pincushion distortion 
is displayed on the screen 59. 

Next, the inverse-distortion information generator 520 includes a reference 
image generator 61 for generating a reference image, outputting it to the image 

10 projection processor 58 and setting a coordinate of the reference image; a 
displacement measurer 62 for measuring a coordinate of the keystone distortion 
and pincushion distortion-occurred image when the reference image is displayed 
on the screen; and a distorted information extractor 63 for extracting image 
distortion information on the basis of the image coordinate outputted from the 

15 reference image generator 61 and the displacement measurer 62 and outputting it 
to the memory 57. 

In the inverse-distortion information generator 520, the reference image 
generator 61 generates a reference image, outputs it to the image projection 
processor 58 and sets a pixel coordinate of the reference image. When the 

20 reference image is displayed on the screen 59 through the image projection 
processor 58, the keystone distortion and the pincushion distortion occur in the 
displayed image. Herein, the displacement measurer 62 measures a pixel 
coordinate of the distorted image. And, a correspondence relation between the 
pixel coordinate (u, v) of the reference image and the pixel coordinate (x, y) of the 

25 distorted image is obtained. Herein, the correspondence relation can be obtained 



through a distortion correcting process using the conventional convergence yoke 
or by setting a coordinate on the screen 59. 

Afterward, the distortion information extractor 63 performs modeling of the 
image distortion mathematically on the basis of the correspondence relation. 
5 Herein, in the mathematical modeling of the image distortion, image warping for 
applying geometrical distortion to the image by converting a pixel position in the 
image is used as an image processing technique. The image is rotated, moved, 
enlarged and reduced through the image warping, a relational expression between 
the pixel coordinate (u, v) of the reference image and the pixel coordinate (x, y) of 

10 the distorted image is obtained through that process, and an inverse-distorted 
image is obtained on the basis of the relational expression. 

Accordingly, the obtained inverse-distortion information is stored in the 
memory 59 of the projection TV unit 510. Afterward, because the projection TV 
unit 510 can predict distortion occurred in displaying of the image on the screen on 

15 the basis of the inverse-distortion information of the memory 57, it performs pre- 
warping of the image, and finally the distortion-corrected image is displayed on 
the screen. 

However, generally a pixel coordinate value of the image passing the 
geometric conversion does not have a constant value, interpolation is necessary in 
20 digital image warping. In addition, the image distortion correcting is performed on 
an actually displayed image, real-time processing is required. 

Hereinafter, the keystone distortion and the pincushion distortion modeling, 
distortion correcting algorithm, virtual screen application and the interpolation 
technique will be described in detail. 
25 In the image distortion correcting method, in extracting of information 



(parameter) related to the keystone distortion and the pincushion distortion 
accurately, the distortion correcting process can be performed accurately through 
the image warping performing the inverse-distortion process. 

Following Equation 1 shows modeling of a keystone distortion on the basis 
5 of relations among a coordinate (u, v) of a reference image, a temporary 
coordinate (X\ Y\ Z'), a coordinate of a distorted image (X, Y) and a parameter (K). 
[Equation 1] 
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io Following Equation 2 shows modeling of pincushion distortion on the basis 

of relations among a coordinate (u, v) of a reference image, a temporary 
coordinate (X\ Y\ Z'), a coordinate of a distorted image (X, Y) and a parameter (K). 
[Equation 2] 

U = U-C X 

v = v-c x 

x = u+u\k u q +K 2 u r 2 ) 

Y = V + v\K v 0 +K 2 v r 2 ) 

15 In the image distortion correcting method, in order to extract a distortion 

parameter as Equation 1 and Equation 2, displacement of characteristic points of 
an image displayed on the screen have to be grasped. However, because the 
keystone distortion and the pincushion distortion complexly occur on an image 
displayed on the screen, it is difficult to obtain the pincushion distortion parameter 



by measuring an image coordinate when the keystone distortion is completely 
corrected or the keystone distortion parameter is obtained by measuring an image 
coordinate when the pincushion distortion is completely corrected. In more detail, it 
is difficult to obtain each parameter corresponded to the keystone distortion and 

5 the pincushion distortion independently. 

In order to solve the above-mentioned problem, in the image distortion 
correcting method in accordance with the present invention, each parameter 
corresponded to the keystone distortion or the pincushion distortion is gradually 
updated after performing general correction about the keystone distortion or the 

10 pincushion distortion. In more detail, the keystone distortion exists uniformly along 
the whole screen, unlike that, the further from the center of the screen, the more 
severely the pincushion distortion occurs. When a certain image coordinate is 
obtained only on the central portion of the screen and a distortion degree is 
measured, the keystone distortion exists constantly, on the contrary, the 

15 pincushion distortion is insignificant. Accordingly, comparatively accurate keystone 
parameter value can be obtained at the central portion of the screen. 

Herein, in the projection TV, the pincushion distortion occurs first by the 
CRT and the lens, afterward, the keystone distortion occurs by the reflector. 
Because the image distortion correcting method performs inverse-distortion of the 

20 image by performing an inverse process of distortion, an inverse process of the 
keystone distortion has to be performed first, afterward, an inverse process of the 
pincushion distortion is performed. 

Figure 6 is a block diagram illustrating an image distortion correcting 
method in accordance with the present invention. As depicted in Figure 6, when a 

25 grid image is displayed on the screen, on the basis of a keystone distortion 



parameter approximately extracted from the displayed grid image, the grid image 
is inverse keystone distortion-processed and is displayed on the screen, and 
accordingly an approximately keystone distortion-corrected image is displayed on 
the screen. Afterward, by extracting a image coordinate again from the keystone 

5 distortion-corrected image, a pincushion distortion parameter is obtained. On the 
basis of the obtained pincushion distortion-parameter, the grid image is inverse 
pincushion distortion-processed and is displayed on the screen, and accordingly 
an approximately pincushion distortion-corrected image is displayed on the screen. 
As described above, by repeating the distortion correcting process alternately, a 

10 distortion parameter value more accurate than a previous distortion parameter 
value can be obtained. Accordingly, a keystone distortion parameter value and a 
pincushion distortion parameter value are updated gradually. 

However, in the image distortion correcting method, because a device 
having a program for obtaining a distortion parameter and an inverse-distorted 

15 image on the basis of Equation 1 and Equation 2 is required, there are difficulties 
to use the method in the general home. In addition, in fabrication of hardware, 
because a user has to correct distortion by updating total twelve distortion 
parameter values directly with a remote controller, it is inconvenient to a user. 
Accordingly, more simplified interface is required. 

20 Hereinafter, in order to solve the above-mentioned problem, a 

convergence distortion correcting method using an elevation technique is 
described. 

Figure 7 is for describing a pincushion distortion phenomenon in 
accordance with the present invention. 
25 As depicted in Figure 7, in consideration of only pincushion distortion, the 



projection TV projects electron beams from a certain point of the CRT 71 to each 
pixel of the screen 72 existing on the two-dimensional plane. Because a distance 
from the CRT 71 to the screen 72 is different from each other and an electron 
beam curving phenomenon occurs due to the surrounding electric field, the 

5 pincushion distortion occurs. Herein, it is assumed the electron beam goes straight, 
a straight line 73 connecting the CRT 71 to a projected point on the screen 72 
shows electron beam locus. 

When it is assumed the image is displayed on the screen without image 
distortion, a line vertically drawn from a pixel of an image displayed on the screen 

10 to the screen and the electron beam locus displaying the pixel cross each other. 
When cross points corresponded to all pixels of the image displayed on the screen 
are connected, a three-dimensional virtual surface 74 can be generated between 
the CRT 71 and the screen 72. In more detail, when a distance (R) from the three- 
dimensional virtual plane 74, the CRT 71 to the actual screen 72 is known, 

15 distortion information about the pincushion distortion can be obtained, and 
mathematical modeling thereof can be performed. 

Figure 8 shows a virtual plane obtained by modeling pincushion distortion 
in accordance with the present invention. 

As depicted in Figure 8, the actual screen exists on a XY plane as Z=0, 

20 the three-dimensional virtual plane is a virtual screen by the pincushion distortion, 
namely, z=fp(x,y) function. Accordingly, a relational equation among the virtual 
screen, the reference image coordinate and the distortion image coordinate can be 
described as following. When a straight line connecting (0,0, R) and 
(x0,y0,fp(x0,y0)) is l 0 , a cross point (u,v) of l Q and the XY plane can be obtained 

25 by following Equation 3. 
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[Equation 3] 

u = , v = ZiVR 

f P ( x o>yo)- R ' f P ( x o>yo)- R 

As shown in Equation 3, the distortion image coordinate (u, v) can be 
obtained by using a distance R from the CRT 71 to the center of the actual screen 
5 72 and a virtual screen function (z=fp(x, y)) value. Herein, the R is a constant 
given to all projection TVs, it means fp(x, y) has all distortion information. For 
example, in a certain pixel, in a random pixel, when a value of fp(x, y) is far less 
than the R, it can be known there is little distortion. 

Figure 9 shows a virtual plane obtained by modeling keystone distortion in 
10 accordance with the present invention. 

As depicted in Figure 9, the keystone distortion modeling is performed by 
a method same with the pincushion distortion modeling and ca be described as 
following Equation 4. In more detail, when a straight line connecting (0,0, R) and 
(x1 ,y1 ,fk(x1 ,y1 )) is /, , a cross point of the /, and the XY plane is (u, v). 
is [Equation 4] 

~x,R _ -y x R 

u ~ /kiwi)-*' V ~ 

As depicted in Equation 4, the distortion image coordinate (u, v) can be 
obtained when a virtual screen function (z=fK(x, y) ) value of the R and the 
keystone distortion is obtained. 
20 However, a virtual screen function of the keystone distortion and the 

pincushion distortion is initialized according to characteristics. In more detail, as 
depicted in Figures 7-9, the pincushion distortion has nonlinear characteristics 
greatly influenced by a distance R from a source of light, on the contrary, the 



keystone distortion has linear characteristics such as reflection of a reflector, and 
accordingly a virtual screen function of the keystone distortion/pincushion 
distortion distortion can be respectively initialized as following Equation 5 and 
Equation 6. 
5 [Equation 5] 

z=f p {x 9 y)=R-^R 2 -x 2 -y 2 
[Equation 6] 
z = f k (x 9 y) = ax + by + d 

As described above, in the image distortion correcting method in 
10 accordance with the present invention, by performing modeling of the keystone 
distortion/pincushion distortion parameter on the basis of the three-dimensional 
virtual screen, a distortion parameter value can be calculated. 

A merit of performing modeling on the basis of the three-dimensional 
virtual screen is capable of showing each distortion only by adding a virtual screen 
15 functional value of the pincushion distortion and a virtual screen functional value of 
the keystone distortion linearly. Accordingly, the distortion can be corrected by 
varying a virtual screen obtained by adding each virtual screen functional value 
without considering the pincushion distortion and the keystone distortion 
independently about all pixels, respectively. But, in order to perform more accurate 
20 distortion correction, the virtual screen has to be updated repeatedly. 

When a updated virtual screen is F n , it can be described as following 
Equation 7. 

[Equation 7] 

F 0 (x,y) = f p (x 9 y) + f k (x,y)=R-ylR 2 -x 2 -y 2 +ax + by + d 
F^(x 9 y)^F m (x 9 y)±A(x 9 y) 



Accordingly, in consideration of Equations 5 ~ 7, a coordinate (u, v) of the 
finally distorted image to a coordinate (x, y) of the reference image can be 
obtained as following Equation 8. 
[Equation 8] 

-xR -yR 

5 U= 7 r , V = ? r 

F n (x,y)-R F n (x,y)-R 

Figure 10 is a flow chart illustrating a virtual screen processing technique 
in accordance with the present invention. 

As depicted in Figure 10, the three-dimensional virtual screen technique 
includes initializing a virtual screen as following Equation 7 on the basis of the 

10 coordinate (x, y) of the .reference image and the coordinate (u, v) of the distorted 
image as shown a step S101; generating an inverse-distorted image l p (x, y) on the 
basis of the initialized virtual screen a shown at step S102; displaying an image 
l w (x,y) distortion-corrected on the basis of the generated inverse-distorted image 
on the screen as shown at step S103; judging whether the image l 0 (x, y) displayed 

is on the screen is coincided to the distortion-corrected image l w (x, y) as shown at 
step S104; updating the virtual screen when the image l Q (x, y) displayed on the 
screen is not coincided to the distortion-corrected image l w (x, y) as shown at step 
S105; and finishing the virtual screen updating when the image l 0 (x, y) displayed 
on the screen is coincided with the distortion-corrected image l w (x,y). Herein, the 

20 virtual screen is updated in the step S105, and the steps are performed repeatedly 
starting from the virtual screen initializing step S101 . 

In the three-dimensional virtual screen technique, an inverse-distortion 
parameter is obtained, and a geometrical conversion function T for performing the 
distortion correction on the basis of the inverse-distortion parameter is obtained. 

20 



And, an inverse-directional warping image is called an inverse-distortion (pe- 
warping) image. 

Following Equation 9 shows a relation among a coordinate (x,y) of the 
reference image, a coordinate (u,v) of a distorted image and a coordinate (u inv , v in v) 
5 of an inverse-distorted image. 
[Equation 9] 

(x,y)=T[(u inv9 v inv )] 
{u,v)=T[(x 9 y)] 

As depicted in Equation 9, in the three-dimensional virtual screen 
technique, in order to obtain the inverse-distorted image, it has to be known which 

10 coordinate is warped to a coordinate of the inverse-distorted image. In more detail, 
in Equation 9, when (Uj nv , v inv ) is warped by the function T, a coordinate of the 
reference image corresponded to the warped image has to be known. Herein, an 
actually obtained coordinate value of the reference image has not an integer value 
but a real number value, interpolation is required. When the obtained inverse- 

15 distorted image is displayed on the screen through the projection, it is converted 
into an image in which distortion of the reference image is corrected, and it is 
outputted. 

However, because an image coordinate calculated in obtaining of the 
inverse-distorted image has a real number unit, when an inverse-corrected image 
20 is obtained by updating the virtual screen, a difference between the obtained 
inverse-corrected image and a previous image (before updating) has to be not 
greater than one pixel. In order to make that difference not greater than one pixel 
unit, in the three-dimensional virtual screen technique, in consideration of a 
present coordinate of an image and a present virtual screen Fn, a step size (A 



(x,y)) is limited so as to be not greater than half pixel. 
[Equation 10] 



a/ x R 2 -Vm 2 + N 2 

A[x,y) = 



2{F n {x,y)+R)^x 2 +y 2 
By substituting Equation 10 for Equation 7, finally the three-dimensional 
virtual screen technique capable of performing pixel unit procesing can be 
described as following Equation 11. 
[Equation 11 ] 

F 0 {x,y) = f p {x,y) + f k {x,y) = R-4R 2 -x 2 -y 2 + ax + by + d 

F..,{*,y)=F.(x,y)±*x,y> « 2 J M '+ N ' 



2(F n (x 9 y)+Ryylx 2 +y 2 

As described-above, the virtual screen technique for performing image 
10 processing by modeling image distortion information three-dimensionally can be 
applied to not only a projection TV but also a video display device based on a LCD 
(liquid crystal display) or a PDP (plasma display panel). In addition, in the virtual 
screen technique, it is possible to divide a virtual screen into a certain blocks in 
processing, it can be freely applied to implementation of hardware by adjusting 
15 distortion information quantity according to picture difference. In addition, it is 
possible to amend distortion information by varying a virtual screen simply, when it 
is implemented as hardware, interface adjustable easily can be fabricated. 

Hereinafter, a silicon convergence device implementing the inverse- 
distortion correcting apparatus as hardware will be described in detail. 
20 Figure 11 is a block diagram illustrating input/output relations of the silicon 

convergence device in accordance with the present invention. 

As depicted in Figure 11, a format converter 111 provides a RGB signal, a 
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horizontal synchronous signal H-Sync), a vertical synchronous signal (V-sync) and 
a clock (Clk_27M) to a silicon convergence device 112. The silicon convergence 
device 112 generates inverse-distortion correction image on the basis of the virtual 
screen technique and outputs it to the format converter 111 , it can be implemented 

5 as a PLD (programmable logic device) such as a FPGA (filed programmable gate 
array), when it is applied to a real product, it is general to use a full-custom method 
as ASIC in the economical or technical aspects. 

The format converter 111 converts a R, G, B video signal having a two- 
dimensional coordinate into a digital video signal by using a vertical frequency, a 

10 horizontal frequency and a pixel frequency. 

The silicon convergence device 112 performs distortion analysis of the 
digital r, g, B video signal received from the format converter 111 on the basis of 
the three-dimensional virtual screen technique, generates inverse-distortion 
information according to it and outputs a pertinent R, G, B signal to the format 

15 converter 111. Herein, the silicon convergence device 112 includes each 
construction part for generating a coordinate of a digital image, storing it and 
performing the above-mentioned interpolation. 

Figure 12 is a block diagram illustrating a generation order of an image 
coordinate in accordance with the present invention. 

20 As depicted in Figure 12, a generation order of the image coordinate is 

based on three stages S121, S122, S123. It will be described in detail. 

First, by counting a positive edge of a vertical synchronous signal (V-Sync), 
an odd number frame and an even number frame are determined. Afterward, the 
image coordinate is generated on the basis of relations of input signals. In more 

25 detail, a positive edge of the horizontal synchronous signal (H-Sync) indicates a 



start of a horizontal line in a vertical synchronous signal high region, by counting a 
positive edge of the horizontal synchronous signal (H-Sync), a vertical coordinate 
is generated. And, when both the vertical synchronous signal (V-Sync) and the 
horizontal synchronous signal (H-Sync) are high, a clock (Clk_27M) indicates a 
5 horizontal frequency of a pixel, by counting a positive edge of a clock, a horizontal 
coordinate can be generated. In addition, in a vertical signal low region, both 
vertical and horizontal coordinates are updated as '0\ in the horizontal 
synchronous signal (H-Sync) low region, only the horizontal coordinate is updated 
as '0'. Accordingly, a two-dimensional coordinate of a digital video signal is 
10 generated by the method, and the generated digital video signal is stored in the 
memory. 

Figure 13 is a block diagram for illustrating a digital image storing method 
in accordance with the present invention. 

As depicted in Figure 13, an input image frame 130 is divided into an even 
15 number frame and an odd number frame, and each frame is processed repeatedly. 
In more detail, when an odd number frame image is stored in the odd number 
frame memory 131, a warped image of the even number frame memory 132 is 
outputted, when an even number frame image is stored in the even number frame 
memory 132, a warped image of the odd number frame memory 131 is outputted, 
20 by performing the process repeatedly, an inverse-distorted image 133 is formed. 

Each memory 131, 132 uses a SRAM (static random access memory) so 
as to perform high speed storing and access of the odd number/even number 
frame, each pixel information includes 9bit of a vertical coordinate, 10bit of a 
horizontal coordinate and 8bit of a pixel value, and accordingly it consists of total 
25 27bit. Accordingly, the ARAM used for the silicon convergence device is designed 



so as to include information such as address 20bit and data 8bit, herein, 9bit of a 
vertical coordinate and 1 0bit of a horizontal coordinate are address bit of the 
silicon convergence device, and 8bit of a pixel value is data bit of the silicon 
convergence device. 

5 Figure 14A illustrates timing at which digital data is written in a memory of 

the image distortion correcting apparatus in accordance with the present invention, 
and Figure 14B illustrates timing at which digital data is read from a memory of the 
image distortion correcting apparatus in accordance with the present invention. 

As depicted in Figures 14A and 14B, when a Clk_27M signal is in a high 

10 region, the image distortion correcting apparatus outputs the horizontal coordinate 
and the vertical coordinate to the ARAM as address bit, when a Clk_27M signal is 
in a low region, the outputted pixel value is stored in the SRAM. In the other hand, 
when the Clk_27M signal is negative edge, the pixel value is read from the SRAM, 
it is for preventing the pixel value from being propagated in the operational 

15 process. 

As described-above, in the pixel value of a digital image, because only an 
integer coordinate exists, the image distortion correcting apparatus, the 
interpolation for changing a real number coordinate value converted through the 
image warping into a pixel value of an integer coordinate is required for the image 
20 distortion correcting apparatus. 

Figure 15 is for describing a concept of one-dimensional signal 
interpolation in accordance with the present invention. 

As depicted in Figure 15, when a data value is distributed at the same 
interval, a method for calculating a request pixel value by using an adjacent pixel 
25 value will be described. 
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When a requested random pixel value is /(*), it can be obtained as 

k-i 

/(*)=X c **(*~ x *)- 



k=0 



Figure 16A illustrates a nearest interpolation function in accordance with 
the present invention, and Figure 16B illustrates Fourier conversion of the nearest 
5 interpolation function in accordance with the present invention. 

As depicted in Figures 16A and 16B, the nearest interpolation is a method 
for using a functional value of an adjacent data as it is, it has the smallest 
complexity. The nearest interpolation technique can be described as following 
Equation 12. 
10 [Equation 12] 

/(*) = /(**) 5^ipL< x <5i^ 

/*(*)= 1 if 0<abs(x)<0,5 

h(x)=0 if 0.5 <abs{x) 

Herein, abs(x) is an absolute value of x, hereinafter, abs of all Equations 
is includes an absolute value. 

In the nearest interpolation function, side robe has comparatively high 
importance in the Fourier function. Accordingly, response characteristics of two 
frequencies are not good and a surrounding pixel value is used as it is, blocky 
apprarance may occur. However, in comparison with other interpolations, the 
20 nearest interpolation function is very simple and has less complexity, recently 
usage thereof is increased. 

Figure 17 is for describing a concept of a two-dimensional nearest 
interpolation in accordance with the present invention. 
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As depicted in Figure 17, alike a first-dimension, in the two-dimensional 
nearest interpolation used for an actual image, interpolation is performed by using 
only a pixel value on the nearest coordinate. 

Figure 18 is for describing a concept of linear interpolation in accordance 
5 with the present invention. 

As depicted in Figure 18, in the linear interpolation, interpolation is 
performed by using a first-dimensional interpolation function with two input signals. 

The linear interpolation can be described as following Equation 13, and 
the linear interpolation function can be described as following Equation 14. 
10 [Equation 13] 



X \ X 0 J 



CWo) 



[Equation 14] 

h(x)=l-abs(x) if 0<abs(x)<l 

h(x)=0 if l<abs(x) 

15 In comparison with the nearest interpolation, the linear interpolation has 

frequency response characteristics almost same with those of a low pass filter, it 
has better function and comparatively simple operational process. 

Figure 19A illustrates a linear interpolation function in accordance with the 
present invention, and Figure 19B illustrates Fourier conversion of the nearest 
20 interpolation function in accordance with the present invention. 

As depicted in Figure 19, unlike the nearest interpolation, in the two- 
dimensional linear interpolation, different significance is given according to a 
distance by using all four pixel values. In addition, in comparison with the nearest 
interpolation, it has greater complexity, however, it is comparatively simple and 
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less operational quantity than the rest interpolations except the nearest 
interpolation. 

Figure 20 is for describing a concept of linear interpolation in accordance 
with the present invention. 
5 As depicted in Figure 20, when f(x,y) is Ax = x-[x], Ay = y- [y], it can be 

described as following Equation 15. 
[Equation 15] 

/(*,jO = (l-AxXl-A>0-^ 

+ (l-Ax).A 3 ;./([4b + l])-hAx.A>;./([^ + l J [y] + l) 

The nearest interpolation performs interpolation by using uses a zero- 
10 dimensional interpolation function, the linear interpolation performs interpolation by 
using the one-dimensional interpolation function, and the three-dimensional 
interpolation performs interpolation by using a three-dimensional interpolation 
function. 

[Equation 16] 

15 h(x) = a 30 abs(xf + a 20 abs(xf + a xo abs(x)+ a 00 if 0 < abs(x) < 1 

h(x)=a 3l abs(xf + a 2l abs(x) 2 + a u abs(x)+ a 0l if \<abs{x)<2 

h(x)=0 if otherwise 

Herein, aij is a constant and has to be determined so as to satisfy following 
conditions. In more detail, when h(0)=1, abs(x)=1, 2, the h(x) has to be '0\ when 
20 abs(x)=0, 1, 2, the h(x) has to be consecutive and a primary differentiation has to 
be consecutive. 

In the above-described interpolation methods, by considering complexity, 
accuracy of a pixel value, intricacy and operational speed of hardware required for 
the operational process, an interpolation method appropriate to the silicon 
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convergence device is selected. 

A pixel required for the nearest interpolation is one, by using one frame 
memory, calculation can be performed with one access. Accordingly, because the 
number of SRAMs is small, it consumes less power in operating of a circuit board 

5 and has faster speed. In addition, a memory access frequency can be set as 
27MHz, a circuit can be operated stably. However, in case of an image having a 
character corresponded to a high frequency or a thin line, the nearest interpolation 
has a demerit as picture quality deterioration. 

In addition, in the linear interpolation, the number of required pixels is four. 

10 Accordingly, in consideration of operational speed of hardware and trade-off of the 
hardware structure, it can be implemented by following three methods. First, the 
linear interpolation performs calculation with one access by using four frame 
memories. Herein, a memory access frequency is 27MHz, and there is no need to 
use a data storing buffer. Second, the linear interpolation performs calculation with 

15 two accesses by using two frame memories. Herein, a memory access frequency 
is 54MHz, and two data storing buffers are required. Third, the linear interpolation 
performs calculation with four accesses by using one frame memory. Herein, a 
memory access frequency is 108MHz, and four data storing buffers are required. 
Herein, in the silicon convergence device, an excessively high frequency is not 

20 appropriate and increase of the number of frame memories causes a certain 
problems, it may inappropriate to use a higher-dimensional interpolation not less 
than the linear interpolation using the SRAM. However, when the silicon 
convergence device is implemented with the SRAM or an AXIS (application- 
specific integrated circuit), operational speed is increased greatly, it is possible to 

25 use a higher-dimensional interpolation such as the linear interpolation, etc. and 



picture quality deterioration (generation loss) can be prevented. 

Figure 21 illustrates interface between a PC and a silicon convergence 
device in accordance with the present invention. 

As depicted in Figure 21, the virtual screen method can adjust detailed 

5 adjustment of a distorted image by dividing an image into several blocks according 
to a request, distortion correction information of a silicon convergence device 212 
can be easily adjusted by using a PC or a notebook computer 211 through a 
parallel port 213. Herein, it is easy to implement a window program for detailed 
adjustment of an image, by using that, the silicon convergence device 212 can be 

10 easily suited for distortion phenomenon different according to each R, G, B image, 
and it is easy to perform distortion correction independently according to each R, 
G, B image. 

Figure 22A illustrates an example of a test image before performing 
conversion correction in accordance with the present invention, and Figure 22B 
15 illustrates an example of a test image after performing distortion conversion. 

As depicted in Figures 22A and 22B, image distortion interpolation based 
on the three-dimensional virtual screen method can be very efficiently operated. 

As described-above, in the image distortion correcting apparatus in 
accordance with the present invention, by correcting image distortion by the digital 
20 image processing method, there is no need to use an additional convergence yoke, 
and accordingly a product can be light-weighted. 

In the image distortion correcting apparatus in accordance with the present 
invention, by correcting image distortion by the digital image processing method, 
influence of an electromagnetic field due to a convergence yoke can be reduced, 
25 and accordingly life-span of a product can be increased. 
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In the image distortion correcting apparatus in accordance with the present 
invention, by correcting image distortion by the digital image processing method, 
adaptability according to a model change of a video display device, design change 
and environment change can be improved. 

5 In addition, in the image distortion correcting apparatus in accordance with 

the present invention, by correcting image distortion by the digital image 
processing method, productivity in a product manufacturing step including an 
image distortion correcting process can be improved. 

As the present invention may be embodied in several forms without 

10 departing from the spirit or essential characteristics thereof, it should also be 
understood that the above-described embodiments are not limited by any of the 
details of the foregoing description, unless otherwise specified, but rather should 
be construed broadly within its spirit and scope as defined in the appended claims, 
and therefore all changes and modifications that fall within the metes and bounds 

is of the claims, or equivalence of such metes and bounds are therefore intended to 
be embraced by the appended claims. 
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